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Description 



ADAPTIVE DE-BLOCKING FILTERING 
APPARATUS AND METHOD FOR MPEG 
VIDEO DECODER 

Background of Invention 
[0001] i. Field of the Invention 

[0002] The present invention generally relates to post-processing 
of block-based coded video, and more particularly to a 
filtering method and apparatus for removing blocking ar- 
tifacts from MPEG-coded video. 

[0003] 2. Description of the Prior Art 

[0004] a wide range of new applications in visual communica- 
tions have been made possible due to the rapidly evolving 
telecommunication and computer industries. Almost all 
the related applications, including video conferencing, 
mobile or PSTN video telephony, video over the Internet, 
and digital TV broadcasting, require very efficient data 
compression methods to fit a large amount of visual in- 



formation into the narrow bandwidth of communication 
channels while preserving acceptable quality of the recon- 
structed data. 

[0005] jo efficiently compress a time variable video sequence, 
redundancy in the temporal domain as well as in the two 
dimensional spatial domain must be reduced. The Moving 
Picture Experts Group (MPEG) standards use a discrete co- 
sine transform (DCT) to reduce the redundancy in the two 
dimensional spatial domain and a motion compensation 
method to reduce the redundancy in the temporal domain. 

[0006] The DCT is a method of reducing the correlativity between 
data through a two dimensional spatial transformation. 
Each block in a picture is spatially transformed using the 
DCT after the picture is divided into blocks. Data that has 
been spatially transformed tends to be driven to a certain 
direction. Only a group of the data driven in the certain 
direction is quantized and transmitted. 

[0007] Pictures, which are consecutive in the temporal domain, 
form motions of a human being or an object at the center 
of the frame. This property is used to reduce the redun- 
dancy of the temporal domain in the motion compensa- 
tion method. A volume of data to be transmitted can be 
minimized by taking out a similar region from the preced- 



ing picture to fill a corresponding region, which has not 
been changed (or has very little change), in the present 
picture. The operation of finding the most similar blocks 
between pictures is called a motion estimation. The dis- 
placement representing a degree of motion is called a 
motion vector. MPEG uses a motion compensation-DCT 
method so that the two methods combine. 
[0008] when a compression technique is combined with a DCT 
algorithm, the DCT transform is usually performed after 
input data is sampled in a unit size of 8x8, and the trans- 
form coefficients are quantized with respect to a visual 
property using quantization values from a quantization 
table. Then, the data is compressed through a run length 
coding (RLC). The data processed with the DCT is con- 
verted from a spatial domain to a frequency domain and 
compressed through the quantization with respect to the 
visual property of human beings, not to be visually recog- 
nized. For example, since the human eye is insensitive to 
high frequencies, a high frequency coefficient is quantized 
using a large step size. Thus, a quantization table is made 
according to external parameters, such as a display char- 
acteristic, watching distance, and noise, to perform an ap- 
propriate quantization. 



[0009] For the quantized data, the data having a relatively high 
frequency is coded with a short code word. The quantized 
data having a low frequency is coded with a long code 
word. Thus, the data is finally compressed. 

[0010] pig.l shows a plurality of adjacent 8x8 pixel blocks 100, 
102, 104 used according to the above described MPEG 
compression. In processing a moving picture as discussed 
above, these blocks 100, 102, 104 are individually pro- 
cessed to maximize the compression ratio and coding ef- 
ficiency. However, this individual processing causes 
blocking artifacts that are noticeable at boundaries be- 
tween blocks. Both horizontal block boundaries 106 and 
vertical block boundaries 108 are present and tend to 
cause square patterns (blocking artifacts) that are quite 
apparent to the human eye. 

[0011] At low coding bit rates, blocking artifacts are a serious 
problem for moving picture compression. Since a real- 
time operation is necessary in coding and decoding a 
moving picture, it is difficult to reduce the blocking arti- 
fact with a small operation capacity. As such, existing 
video compression algorithms and standards continue to 
have unwanted visual artifacts appear when the original 
information is compressed with loss, and these unwanted 



visual artifacts become more visible when the coding bit 
rates become lower. 

[0012] | n the traditional block-based video compression stan- 
dards such as MPEG-1 and MPEG-2, the blocking artifact 
is the most noticeable artifact. In actuality, there are two 
main sources of blocking artifacts. As mentioned previ- 
ously, the major source comes from individually encoding 
each 8x8 DCT block without considering the correlation 
between adjacent blocks. In this case, coarse quantization 
of the transform coefficients causes discontinuities at the 
block boundaries. The second source of blocking artifacts 
is from the motion compensated prediction. Motion com- 
pensation involves coding pixel data from a reference 
frame and results in a discontinuity at the edge of the 
copied block. Additionally, any blocking artifacts existing 
in the reference frame may also be propagated to a cur- 
rent frame due to copying process. As such, the blocking 
artifacts resulting from motion compensated prediction 
can occur at any position inside an 8x8 predictive block. 

[0013] Accordingly, various methods for reducing blocking arti- 
facts in coding systems that individually processes blocks 
have been developed. For example, de-blocking filters can 
be integrated into a video codec as either a loop filter or a 



post filter. Loop filters operate inside the motion compen- 
sation loop so that the filtered frames are used as refer- 
ence frames of subsequent coded frames. However, this 
method of changing the processes of coding and decod- 
ing increases the amount of bits to be transmitted. Addi- 
tionally, such an approach is unacceptable in many situa- 
tions because the resulting data stream no longer com- 
plies with the applicable standards. Unlike loop filters, 
post filters operate on the decoded bit stream outside the 
coding loop. Thus, post filters can operate in conjunction 
with the original video compression standards. In other 
words, post filters can be easily integrated into any stan- 
dard decoder using various implementation methods de- 
signed independent of the standard. A great amount of 
work has been done in the field of de-blocking filters, and 
the following papers are incorporated herein by reference: 

[0014] [i] r_ Rosenholtz and A. Zakhor, "Iterative procedures for 
reduction of blocking effects in transform image coding," 
IEEE Trans. Circuits Syst. Video Technol., vol. 2, pp. 
91-95, Mar. 1992. 

[0015] [2] y. Yang, N. P. Galatsanos, and A. K. Katsaggelos, "Reg- 
ularized reconstruction to reduce blocking artifacts of 
block discrete cosine transform compressed image, "IEEE 



Trans. Circuits Syst. Video Technol., vol. 3, pp.42 1-432, 
Dec. 1993. 

[0016] [3] Y. Yang, N. P. Galatsanos, and A. K. Katasaggelos, "Pro- 
jection-based spatially adaptive reconstruction of block- 
transform compressed images, "IEEE Trans. Image Pro- 
cessing, vol. 4, pp. 896-908, July 1995. 

[0017] [ 4 ] j Meier, K. N. Ngan, and G. Grebbin, "Reduction of 
blocking artifacts in image and video coding, "IEEE Trans. 
Circuits Syst. Video Technol., vol. 9, pp. 490-500, April 
1999. 

[0018] [5] j. P. CTRourke and R. L. Stevenson, "Improved image 
decompression for reduced transform coding arti- 
facts, "IEEE Trans. Circuits Syst. Video Technol., vol. 5, pp. 
490-499, Dec. 1995. 

[0019] [6] h. W. Park and Y. L. Lee, "A postprocessing method for 
reducing quantization effect in low bit-rate moving pic- 
ture coding, "IEEE Trans. Circuits Syst. Video Technol., vol. 
9, pp. 161-171, Feb. 1999 

[0020] [ 7 ] s . D. Kim, J. Yi, H. M. Kim, and J. B. Ra, "A deblocking 
filter with two separate modes in block-based video cod- 
ing", IEEE Trans. Circuits Syst. Video Technol., vol. 9, pp. 
156-160, Feb. 1999 

[0021] [8] p. List, A. Joch, J. Lainema, G. Bjontegaard, and M. Kar- 



czewicz, "Adaptive deblocking filter,"IEEE Trans. Circuits 
Syst. Video Technol., vol. 13, pp. 614-619, July 2003. 

[0022] There are two approaches commonly adopted to reduce 
blocking artifacts: an iterative approach (references [1-5]) 
and a non-iterative approach (references [6-8]). Several 
iterative de-blocking methods have been used to alleviate 
blocking artifacts, including projection onto convex sets 
(POCS) (references [1-3]), Markov random field (MRF) 
(reference [4]), and maximum a posteriori (MAP) restora- 
tion (reference [5]). The main drawback of these iterative 
de-blocking methods is their high computational com- 
plexity, which prevents them from being used in a real- 
time video decoder. 

[0023] Conversely, especially for real time applications, non- 
iterative de-blocking methods mostly using adaptive fil- 
ters have also been adopted to reduce blocking artifacts. 
Park et al. (reference [6]) define a blocking semaphore to 
represent the strength of the blocking artifacts in the 
MPEG-4 decoder. The blocking semaphore is extracted 
from the DCT domain of each 8x8 block in the intra video 
object plane (VOP). The semaphores of the inter-VOP are 
calculated from both the residual signal and the 
semaphores of the reference VOP. Then, a one- 



dimensional strong low-pass filter and a special type of 
weak filter are adaptively applied on the horizontal and 
vertical block boundary to the blocking semaphores. 
[0024] pig. 2 shows a block diagram showing the mode decision 
procedure for a de-blocking filter having two separate fil- 
tering modes as proposed by Kim et al. (reference [7]). 
This de-blocking filter has also been included as an infor- 
mation section in the MPEG-4 video standard. The pro- 
posed filter performs one-dimensional filtering along the 
horizontal (and vertical) block boundaries 200 between 
8x8 pixel blocks. In step 202, local image characteristics 
around the block boundary 200 are examined to deter- 
mine if the block boundary 202 is a smooth region. In 
steps 204 and 206, an assessment is performed to deter- 
mine if the block boundary represents a real edge that 
should be present in the image. If the block boundary is 
not a real edge, for the smooth region mode 212 to which 
flat regions belong, a strong nine-tap smoothing filter is 
applied to pixels inside the blocks as well as to the pixels 
at the block boundary. More specifically, the strong nine- 
tap filter is applied to pixels v to v . For the default re- 
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gion mode 208, to which complex regions belong, a fre- 
quency analysis technique using 4-pt DCT kernel is used 



to filter pixels and at the block boundary only. If the 
block boundary 200 represents a real edge (steps 210 and 
214), no filtering is applied. The de-blocking method pro- 
posed by Kim et al. results in high subjective quality of 
decoded images at low bit rates; however, it smoothes 
real edges and severely degrades the objective quality at 
higher bit rates due to the strong low-pass filter used in 
the smooth region mode. Moreover, this method does not 
consider block artifacts in inter-coded MBs that are 
caused by the motion compensated prediction. 
[0025] |_j S t et al. (reference [8]) propose a sophisticated in-loop 
de-blocking filter for the H.264/MPEC-4 AVC video cod- 
ing standard. The proposed in-loop de-blocking filter 
performs one-dimensional filtering along the block 
boundaries of a 4x4 block, which is the basic coding unit 
of the H.264 video codec. The 4x4 block boundaries are 
assigned boundary-strength (Bs) parameters from 0 to 4. 
Block boundaries having a B equal to 0 are not filtered, 
and a special type of weak filter is applied to block 
boundaries having Bs from 1 to 3. Finally, a stronger low- 
pass filter is applied to block boundaries having a B equal 
to 4. The in-loop de-blocking method proposed by List et 
al. improves both the subjective and objective quality, es- 



pecially at low bit rates. However, due to its highly adap- 
tive nature, this method also has a very high computa- 
tional complexity. The filter can account for one-third of 
the computational complexity of an H.264/MPEG-4 AVC 
decoder even after a tremendous effort has been made in 
speed optimization of the filtering algorithms. 
[0026] Accordingly, due to the above limitations, most of the 
prior art is only suitable for de-blocking filtering at low 
bit rates and is unable to provide satisfactory results at 
higher bit rates. However, the demand for de-blocking fil- 
tering of MPEG-encoded video at medium to high bit rates 
is increasing due to the wide acceptance of MPEG applica- 
tions, such as digital versatile discs (DVDs) and digital TV. 
Summary of Invention 

[0027] one objective of the claimed invention is therefore to pro- 
vide a highly adaptive de-blocking filter for an MPEG video 
decoder that can be used for both frame-coded and field- 
coded pictures at a wide range of bit rates with low com- 
putational complexity, to solve the above-mentioned 
problems. 

[0028] According to the claimed invention, a method is disclosed 
for reducing a blocking artifact in a video stream, the 
method comprising: determining a filtering range accord- 



ing to block coding types of a plurality of adjacent blocks 
in the video stream, wherein the filtering range specifies a 
number of pixels to filter around a block boundary be- 
tween the adjacent blocks; and filtering a plurality of pix- 
els around the block boundary according to the filtering 
range to reduce the blocking artifact in the video stream. 

[0029] Also according to the claimed invention, a method is dis- 
closed for reducing a blocking artifact in a video stream, 
the method comprising: calculating an activity value rep- 
resenting local activity around a block boundary between 
a plurality of adjacent blocks in the video stream; deter- 
mining a region mode for the block boundary according 
to the activity value; and selecting one of a plurality of at 
least three filters to filter a plurality of pixels around the 
block boundary to reduce the blocking artifact according 
to the region mode. 

[0030] Also according to the claimed invention, a method is dis- 
closed for reducing a blocking artifact in a video stream, 
the method comprising: calculating an activity value rep- 
resenting local activity around a block boundary between 
a plurality of adjacent blocks in the video stream; deter- 
mining a region mode for the block boundary according 
to the activity value; and filtering a plurality of pixels 



around the block boundary according to the region mode 
and the quantization parameters (QPs) of the adjacent 
blocks, wherein the filtered pixels are further refined ac- 
cording to the quantization parameters (QPs) of the adja- 
cent blocks, or wherein symmetric filters or asymmetric 
filters are used to filter the pixels according to the quanti- 
zation parameters (QPs) of the adjacent blocks. 

[0031] Also according to the claimed invention, a method is dis- 
closed for reducing a blocking artifact in a video stream, 
the method comprising: calculating an activity value rep- 
resenting the local activity around a block boundary be- 
tween a plurality of adjacent blocks in the video stream; 
determining a region mode for the block boundary ac- 
cording to the activity value; adaptively determining a plu- 
rality of thresholds according to at least differences in the 
values of quantization parameters (QPs) of the adjacent 
blocks; and filtering a plurality of pixels around the block 
boundary to reduce the blocking artifact according to the 
region mode and the plurality of thresholds. 

[0032] Also according to the claimed invention, a method is dis- 
closed for reducing a blocking artifact in a video stream, 
the method comprising: determining a region mode for a 
block boundary between a plurality of adjacent blocks in 



the video stream; and filtering a plurality of pixels around 
the block boundary to reduce the blocking artifact accord- 
ing to the region mode; wherein filtering the pixels 
around the block boundary comprises first filtering the 
pixels at the block boundary and next filtering pixels not 
adjacent to the pixels at the block boundary. 
[0033] Also according to the claimed invention, a method is dis- 
closed for reducing a blocking artifact in a video stream, 
the method comprising: calculating an activity value rep- 
resenting local activity around a block boundary between 
a plurality of adjacent blocks in the video stream; deter- 
mining a region mode for the block boundary according 
to the activity value; and selecting one of a plurality of fil- 
ters to filter a plurality of pixels around the block bound- 
ary to reduce the blocking artifact according to the region 
mode; wherein at least one of the filters is a one dimen- 
sional filter formed by using a 4-point Hadamard Trans- 
form (HT). 

[0034] Also according to the claimed invention, a method is dis- 
closed for reducing a blocking artifact in a video stream, 
the method comprising: calculating an activity value rep- 
resenting local activity around a block boundary between 
a plurality of adjacent blocks in the video stream; deter- 



mining a region mode according to the activity value; de- 
termining a plurality of thresholds; the thresholds taking 
into account a user defined offset (UDO) allowing the 
thresholds to be adjusted according to the UDO value; and 
filtering a plurality of pixels around the block boundary 
according to the region mode and the thresholds. 
[0035] Also according to the claimed invention, a post processing 
de-blocking filter is disclosed. The post processing de- 
blocking filter comprises: a threshold determination unit 
for adaptively determining a plurality of threshold values 
according to at least differences in quantization parame- 
ters QPs of a plurality of adjacent blocks in a received 
video stream and according to a user defined offset (UDO) 
allowing the threshold levels to be adjusted according to 
the UDO value; an interpolation unit for performing an in- 
terpolation operation to estimate pixel values in an inter- 
laced field if the video stream comprises interlaced video; 
and a de-blocking filtering unit for determining a filtering 
range specifying a maximum number of pixels to filter 
around a block boundary between the adjacent blocks, for 
determining a region mode according to local activity 
around the block boundary, for selecting one of a plurality 
of at least three filters to filter pixels around the block 



boundary to reduce the blocking artifact, and for filtering 
a plurality of pixels around the block boundary according 
to the filtering range, the region mode, and the selected 
filter. Wherein the de-blocking filtering unit further re- 
fines the filtered pixels according to the quantization pa- 
rameters QPs of the adjacent blocks, or uses symmetric 
filters or asymmetric filters to filter the pixels according to 
the quantization parameters QPs of the adjacent blocks; 
the de-blocking filtering unit first filters the pixels at the 
block boundary and next filters pixels not adjacent to the 
pixels at the block boundary; and at least one of the filters 
is a one dimensional filter formed by using a 4-point 
Hadamard Transform (HT). 
[0036] These and other objectives of the claimed invention will 
no doubt become obvious to those of ordinary skill in the 
art after reading the following detailed description of the 
preferred embodiment that is illustrated in the various 
figures and drawings. 
Brief Description of Drawings 

[0037] pig.l shows a plurality of adjacent 8x8 pixel blocks ac- 
cording to the prior art. 

[0038] pig. 2 shows a block diagram showing the mode decision 
procedure for a de-blocking filter having two separate fil- 



tering modes according to the prior art. 

[0039] pig. 3 is a block diagram showing a video decoder incor- 
porating a post-processing de-blocking device according 
to the present invention. 

[0040] pig. 4 illustrates a horizontal 8x8 block boundary and pixel 
indexes according to the present invention. 

[0041] Fig. 5 illustrates a vertical 8x8 block boundary and the 
pixel indexes according to the present invention. 

[0042] Fig. 6 is a flowchart describing the mode decision proce- 
dure for the post-processing device of Fig. 3. 

[0043] Fig. 7 is a one-dimensional view of a block boundary be- 
fore filtering with the F-l filter. 

[0044] Fig. 8 is a one dimensional view of the block boundary of 
Fig. 7 after filtering with the F-l filter. 

[0045] Fig. 9 shows how filtering and v g with asymmetric filters 
can achieve a result similar to the case when the two adja- 
cent blocks are coded with the same QP value. 

[0046] Fig. 10 illustrates using the symmetric F-2 filter to filter 
the pixels and v g belonging to first and second 8x8 
blocks having equal QP values. 

[0047] Fig. 11 illustrates using the asymmetric F-2 filter to filter 
the pixels and v g belonging to first and second 8x8 
blocks having different QP values. 



[0048] Fig. 12 illustrates using the symmetric F-3 filter to filter 

the pixels and v g belonging to first and second 8x8 

blocks having equal QP values. 
[0049] Fig. 13 illustrates using the asymmetric F-3 filter to filter 

the pixels and v g belonging to first and second 8x8 

blocks having different QP values. 
[0050] Fig. 14 is a flowchart further describing the mode decision 

procedure for Category 1. 
[0051] Fig. 15 shows a flowchart describing the operation of the 

de-blocking filtering unit for a Category 1 type block 

boundary when the region mode is determined to be 

Ml-INTRA. 

[0052] Fig. 16 shows the results of the filtering operations de- 
scribed in Fig. 15 on the pixels around the block boundary. 

[0053] Fig. 17 shows a flowchart describing the operation of the 
de-blocking filtering unit for a Category 1 type block 
boundary when the region mode is determined to be 
M2-INTRA. 

[0054] Fig. 18 shows the results of the filtering operations de- 
scribed in Fig. 17 on the pixels around the block boundary. 

[0055] Fig. 19 shows a flowchart describing the operation of the 
de-blocking filtering unit for a Category 1 type block 
boundary when the region mode is determined to be 



M3-INTRA. 

[0056] Fig. 20 shows the results of the filtering operations de- 
scribed in Fig. 19 on the pixels around the block boundary. 

[0057] Fig. 21 is a flowchart further describing the mode decision 
procedure for Category 2. 

[0058] Fig. 22 shows a flowchart describing the operation of the 
de-blocking filtering unit for a Category 2 type block 
boundary when the region mode is determined to be 
MI-INTER. 

[0059] Fig. 23 shows the results of the filtering operations de- 
scribed in Fig. 22 on the pixels around the block boundary. 

[0060] Fig. 24 shows a flowchart describing the operation of the 
de-blocking filtering unit for a Category 2 type block 
boundary when the region mode is determined to be 
M2-INTER. 

[0061] Fig. 25 shows the results of the filtering operations de- 
scribed in Fig. 24 on the pixels around the block boundary. 

[0062] Fig. 26 shows a flowchart describing the operation of the 
de-blocking filtering unit for a Category 2 type block 
boundary when the region mode is determined to be 
M3-INTER. 

[0063] Fig. 27 shows the results of the filtering operations de- 
scribed in Fig. 26 on the pixels around the block boundary. 



[0064] Fig. 28 shows a horizontal boundary in two field pictures 
corresponding to a single frame in interlaced video. 

[0065] Fig. 29 shows the averaging operations used to implement 
the interpolation operations for horizontal boundary fil- 
tering of a field-coded picture according to the present 
invention. 
Detailed Description 

[0066] Fig. 3 is a block diagram showing a video decoder 300 in- 
corporating a post-processing de-blocking device 302 
according to the present invention. As described previ- 
ously, when the de-blocking filter is integrated into a 
video decoder 300 as a post-processing de-blocking de- 
vice 302, the post-processing de-blocking device 302 
operates on decoded frames after the decoding loop. In 
the block diagram shown in Fig.l, the post-processing 
de-blocking device 302 comprises three units: a picture- 
information extraction and buffering unit 304, a picture- 
information reordering unit 306, and a post-processing 
unit 308. The post-processing unit 308 is cascaded with a 
standard MPEG decoder 310 without changing the bit 
stream syntax of an input bit stream I. The standard MPEG 
decoder 310 receives the input bit stream I and includes a 
buffer 340, a variable length code (VLC) decoder 342, an 



inverse quantizer 344, a summing unit 346, a motion 
compensation unit 348, previous picture storage 322, and 
future picture storage 324. As the operation of the stan- 
dard MPEG decoder 310 is well-known to a person skilled 
in the art of MPEG decoding, further description of its op- 
eration is omitted. 
[0067] The picture-information extraction and buffering unit 304 
further includes three subunits: a QP extraction unit 312, 
a motion vector extraction unit 314, and a block type ex- 
traction unit 316. The QP extraction unit 101 extracts the 
QP of each macroblock (MB) and stores it in a first pic- 
ture-information buffer. The QP value of an intra-coded 
or inter-coded MB can be obtained from the bit stream di- 
rectly. However, the QP value of a skipped MB is not avail- 
able from the bit stream. For skipped MBs, the QP value is 
estimated from the QP values of collocated MBs in the ref- 
erence frames. When the skipped MB is in a P-picture, the 
QP is estimated using the QP of a collocated MB in the 
forward reference frame. If the skipped MB is in a B- 
picture, the QP is estimated by averaging two QP values 
obtained from collocated MBs in the forward and back- 
ward reference frames. The motion vector extraction unit 
314 extracts and stores in a second picture-information 



buffer the motion vector indicator (MVI) of each MB rather 
than the motion vector itself. The MVI is calculated using 
the following criterions: If one of the horizontal or vertical 
motions is larger than 2xmv pixels, then the MVI is set to 
a value of 2. When the motion is larger than mv, the MVI is 
set to a value of 1. Where, the value mv is a function of 
the picture size and is defined as follows: if the picture 
size is smaller than the CIF format, mv is set to a value of 
1, otherwise, mv is set to a value of 2. A buffered MVI is 
used for determining thresholds used by the post- 
processing de-blocking device 302. The block type ex- 
traction unit 316 extracts and stores the 8x8 block coding 
type in a third picture-information buffer. The block cod- 
ing type can be intra-coded, inter-coded, or skipped, and 
the block coding type can be obtained directly from the 
bit stream. 

[0068] The picture-information reordering unit 306 includes pre- 
vious picture-information storage 318 and future picture- 
information storage unit 320. The picture-information re- 
ordering unit 306 simply reorders the data stored in the 
above mentioned three picture-information buffers in the 
picture-information extraction and buffering unit 304. 
The reordering is performed in the same way as the pic- 



ture reordering units (previous picture storage 322 and 
future picture storage 324) in the standard MPEG decoder 
310. The reason why the buffering and reordering of pic- 
ture-information is necessary is that de-blocking device 
302 operates outside of the decoding loop. Thus neces- 
sary information, such as the data stored in the three pic- 
ture-information buffers, must be preserved and trans- 
mitted to the post-processing unit 308. 
[0069] The post-processing unit 308 includes three subunits: a 
threshold determination unit 326, an interpolation unit 
330, and a de-blocking filtering unit 328. The threshold 
determination unit 326 determines the proper threshold 
values for a mode decision and a filtering decision using 
the information received from the picture-information ex- 
traction and buffering unit 304. The threshold values are 
determined and adapted for each filtering operation based 
on various types of coding information, including QP val- 
ues, absolute differences of QP values, picture coding 
types, as well as block coding type. It should be noted 
that other types of coding information can also be used to 
determine the threshold values. The interpolation unit 330 
is used only for field-coded pictures and estimates pixel 
values of opposite fields using a simple interpolation 



technique so that the same de-blocking filter can be ap- 
plied to both frame-coded and field-coded pictures with- 
out requiring significant modification. The de-blocking 
filtering unit 328 performs adaptive filtering to remove 
blocking artifacts around each 8x8 block boundary. In the 
de-blocking filtering unit 328, the block boundary is first 
classified into one of two categories based on the block 
coding types and is then further classified into one of 
three region modes for each category. Therefore, there 
are total six modes to choose for de-blocking. Different 
one-dimensional filters are applied to the block boundary 
according to the mode. The implementation of the post- 
processing unit 302 is further described in the subse- 
quent sections of the detailed description of the present 
invention. 

[0070] please refer to Fig. 4 and Fig. 5. Fig. 4 illustrates a horizon- 
tal 8x8 block boundary 400 and pixel indexes (v q to v ) 
used according to the present invention. Fig. 5 illustrates a 
vertical 8x8 block boundary 500 and the pixel indexes (v q 
to v is ) used according to the present invention. Horizon- 
tally or vertically adjacent 8x8 blocks can be encoded with 
different QPs (QP1 and QP2) if the two blocks belong to 
different MBs. In the present invention, whenever the de- 



coded frame is filtered, one-dimensional horizontal filter- 
ing is first applied and is then followed by one- 
dimensional vertical filtering. That is, a set of one- 
dimensional de-blocking filters is first applied to vertical 
boundaries and then to horizontal boundaries. Moreover, 
each filtered pixel value is used for subsequent filtering 
operations. 

[0071] pig. 6 is a flowchart describing the mode decision proce- 
dure for the post-processing unit 308 of Fig.3.As shown 
in Fig. 6, a block boundary 600 is classified into one of six 
modes before it is filtered. The block boundary 600 can 
be either a vertical block boundary 500 as shown in Fig. 5 
or a horizontal block boundary 400 as shown in Fig. 4. In 
step 610, the block boundary 600 formed by a first 8x8 
block 602 and an adjacent 8x8 block 604 is examined to 
determine if at least one of either the first block 602 or 
the second block 604 is an intra coded block. If at least 
one of the adjacent 8x8 blocks 602, 604 is intra coded, 
the block boundary 600 is determined to be in Category 
1, otherwise, in Category 2. These categories determine a 
filtering range of the de-blocking filtering unit 328. For 
Category 1, at most four pixels around the block bound- 
ary 600 are examined and filtered, and for Category 2, at 



most eight pixels are examined and filtered. If one of the 
adjacent blocks 602, 604 is an intra coded block, in steps 
612 and 614, an activity value corresponding to pixel val- 
ues around the block boundary 600 is used to determine 
a region mode. Likewise, if neither of the adjacent blocks 
602, 604 is an intra coded block, in steps 616 and 618, 
the activity value is used to determine the region mode. 
According to the present invention, for each category, 
there are three types of region modes: active region 
(Ml-INTRA, MI-INTER), smooth region (M2-INTRA, 
M2-INTER), and dormant region (M3-INTRA, M3-INTER). 
Active region corresponds to significantly varying pixel 
values around the block boundary 600, smooth region 
corresponds to moderately constant pixel values around 
the block boundary 600, and dormant region corresponds 
to extremely constant pixel values around the block 
boundary 600. 

[0072] | n order to determine the region mode, the activity value 
is computed as a sum of absolute differences between 
pixel values around the block boundary 600 as follows: 

ACTIVITY^, -v^l + S^-v^l (1) 

[0073] using separate thresholds for each category, a block 



boundary 600 is considered to be in the active region if 
ACTIVITY is larger than a first threshold value, in the 
smooth region if ACTIVITY is larger than a second thresh- 
old value but smaller than or equal to the first threshold 
value, and in the dormant region if ACTIVITY is smaller 
than or equal to the second threshold. In a flat region 
having generally constant pixel values, even a small 
change in a pixel value can cause an annoying blocking 
artifact visible to the human eye. For this reason, the prior 
art applies a strong low-pass filter to flat regions. How- 
ever, while the strong low-pass filter improves subjective 
quality at low bit rates, it also reduces the sharpness of 
the picture and degrades the objective quality at higher 
bit rates. However, if only a weak low-pass filter is applied 
to flat regions, even though the objective quality can be 
improved at high bit rates, the subjective quality may not 
be satisfied at lower bit rates. Thus, the present invention 
further divides these flat regions into two categories 
(smooth and dormant) and applies different filters to each 
of them. By controlling the amount of strong and weak 
low-pass filtering, the present invention is able to achieve 
a trade-off between subjective and objective quality. 
[OO 74 ] For active regions (Ml- INTRA, MI-INTER), pixels around 



the block boundary 600 are filtered using a special filter 
F-l. For smooth regions (M2-INTRA, M2-INTER), a set of 
weak low-pass filters F-2 is applied to the block boundary 
600. If the region is extremely flat, i.e. for dormant re- 
gions (M3-INTRA, M3-INTER), a set of strong low-pass fil- 
ters F-3 is applied to the block boundary 600. Further de- 
scription of the three filters F-l, F-2, and F-3 is as fol- 
lows. 

[0075] The special filter F-l is formed using a 4-pt orthogonal 
Hadamard transform (HT) kernel. This frequency analysis 
technique is used instead of low-pass filtering because 
low-pass filtering would smooth out any real edges in ac- 
tive regions. Suppose that two pixels, v 7 and v g are fil- 
tered using F-l. In order to filter these two pixels, the 
four pixels v g , v^, v g and v g are analyzed using the or- 
thogonal HT kernel. Let c , c , c and c be the coeffi- 

3 0 12 3 

cients of the HT. Then, the HT and the inverse HT are as 
follows: 
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[0076] | n the present invention, the high frequency component c. 



is reduced to 0 before the inverse HT is performed to re- 
move the blocking artifact and only and v g are changed 
(filtered) to v 7 " and v g " as follows: 



v 7 '=I[l 1 -1 -1 



i[l -1 -1 1 



where c, '= c, - A = 0 => A = 



[0077] Thus, filtered results, v " and v " can be obtained without 

'7 8 , 

actually performing an inverse HT using the following for- 
mula: 



V.-.-A2 where A1 = A2 = — 
8 2 



(2) 



[0078] jhe present invention further refines these filtered values, 
using a weighted clipping technique. Let WT1 and WT2 be 
weighting factors, which are functions of QP values ob- 
tained from two adjacent blocks as shown in the following 
formula: 



wn 



= QPl 



V 



QP2 ' m2 ~ QP /QPl +QP2 



(3) 



[0079] qpi anc | QP2 are respective quantization parameters of 
MBs that having the boundary pixels v 7 and v g . Using th 
clipping technique with the two weighting factors, 



A 



1 and 

A 



2 are further refined as shown in the following formula: 

v 7 '= v 7 + Al , v s '= v s - A2 where 

Al = clip(A- WTl 0, (i% - 1*) ■ WT1) , A3 = ciipC.ll- WT 2, 0, 0, - v 7 ) ■ EfT 2) (4) 
isrrctJ clip(x, I, u) clips xto a value between 1 and u 

[0080] please refer to Fig. 7 and Fig. 8. Fig. 7 is a one-dimensional 
view of a block boundary before filtering with the F-l fil- 
ter. Fig. 8 is a one dimensional view of the block boundary 
of Fig. 7 after filtering with the F-l filter. In Fig. 7 and 
Fig. 8, the block boundary is formed between two adjacent 
blocks having QP values of QP1 and QP2, respectively. In 
this example, QP1 is greater than QP2. A larger QP value 
means that the step sizes used to quantize the pixel val- 
ues are larger, and therefore, that the error value associ- 
ated with the larger QP pixel values is generally larger. As 
such, pixel values having smaller QP values can be con- 
sidered more accurate. Using the above weighted clipping 
technique, a pixel quantized with a larger QP value will 
have more change in value after filtering than a pixel 
quantized with a smaller QP value. This can be seen if 
Fig. 8 where the change in value 



A 



1 of the pixel v7 is larger than the change in value 

A 

2 of the pixel v8. This is beneficial because the more ac- 
curate pixel values (being quantized with the lower QP 
value) are changed less by the F-l filter and therefore a 
more accurate result is obtained. 

[0081] The set of weak low-pass filters F-2 is applied to smooth 

regions (M2-INTRA, M2-INTRER). If QP1 is equal to QP2, 

the v and v pixels are filtered with the F-2 filter being 
7 8 K a 

defined as a symmetric 5-tap low-pass filter [13 8 3 
1]/16 shown in the following formula: 

v 7 '=(y s +3-v ( + 8 v 7 + 3-v 8 + v 9 )f\6, v 8 '=(v ( + 3 v 7 + 8 v 8 + 3 v 9 + v lt )f\6 (5) 

[0082] However, if QP1 is not equal to QP2, the v and v pixels 

7 8 

are filtered with the F-2 filter being defined as asymmetric 
5-tab low-pass filters [1 2 8 3 2]/16 and [2 3 8 2 1]/16, 
respectively, as shown in the following formula: 

v 7 '=(v j +2-v ( + 8-v T + 3 v s + 2 v 9 )fl6, v 8 ' = (2-v, +3 v 7 +8 v 8 + 2 v 9 + v 1(t )/l6 (&) 

[0083] pig. 9 shows filtering of and v g using asymmetric filters 
when the two adjacent blocks are coded with different QP 



values. The reason for using symmetric and asymmetric 
versions of the F-2 filter (and of the F-3 filter described 
later) is that blocking artifacts are generally more visible 
when the adjacent blocks forming the block boundary 600 
are coded with different QP values. By applying different 
weightings during the filtering process, the effect of dif- 
ferent QP values can be neutralized. For example, as 
shown in Fig. 9, suppose two adjacent blocks are coded 
with a first QP value QP1 equal to 15 and a second QP 
value QP2 equal to 17, respectively. Then, filtering and 
v g with asymmetric filters can achieve a result similar to 
the case when the two adjacent blocks are coded with the 
same QP value having a value equal to 16. 
[0084] please refer to Fig. 10 and Fig. 11. Fig. 10 illustrates using 
the symmetric F-2 filter being the 5-tap low-pass filter [1 
3 8 3 1]/16 to filter the pixels and v g belonging to first 
and second 8x8 blocks having equal QP values. As shown 
in Fig. 10, the symmetric F-2 filter is first applied to and 
then applied to v using the formulas (5) shown above. 

8 

Fig. 11 illustrates using the asymmetric F-2 filter being the 
5-tab low-pass filters: [1 2 8 3 2]/16 and [2 3 8 2 1]/16 
to filter the pixels and v g belonging to first and second 
8x8 blocks having different QP values. Similar to as shown 



in Fig. 10, the asymmetric F-2 filter shown in Fig. 11 is first 
applied to and then applied to v g using the formulas (6) 
shown above. It should be noted that when using the 
asymmetric filters, slightly more weighting is given to the 
adjacent 8x8 block when compared with the symmetric 
filters. Intuitively, this has an effect similar to adjusting 
the QP values of the two adjacent 8x8 blocks to be equiv- 
alent as shown in Fig. 9. 
[0085] The set of strong low-pass filters F-3 is applied to dor- 
mant regions (M3-INTRA, M3-INTER). If QP1 is equal to 
QP2,thev and v pixels are filtered with the F-3 filter 

7 8 

being defined as a symmetric 5-tap low-pass filter [12 2 
2 l]/8 shown in the following formula: 

v' 7 =(y s + 2v t +2-v 7 + 2-v 8 +v 9 )/8, v , 8 =(y t +2-v 7 + 2-v s + 2-v 9 +v 1( )/8 (7) 

[0086] However, if QP1 is not equal to QP2, the v and v pixels 

7 8 

are filtered with a asymmetric F-3 filter being defined as 
5-tab low-pass filters [1 1 2 2 2]/8 and [2 2 2 1 l]/8, re- 
spectively, as shown in the following formula: 

v' 7 = (y i + v f + 2 v y + 2- v 8 + 2- v s )/8 , v' s =(2- v ( + 2 ■ v 7 + 2- v s +v ? + v 10 )/8 (8) 

[0087] please refer to Fig. 12 and Fig. 13. Fig. 12 illustrates using 
the symmetric F-3 filter being the 5-tap low-pass filter [1 
2 2 2 l]/8 to filter the pixels v 7 and v g belonging to first 
and second 8x8 blocks having equal QP values. As shown 



in Fig. 12, the symmetric F-3 filter is first applied to v 7 and 
then applied to v using the formulas (7) shown above. 

8 

Fig. 13 illustrates using the asymmetric F-3 filter (5-tab 
low-pass filters being the 5-tap low-pass filters: [112 2 
2]/8 and [2 2 2 1 l]/8 to filter the pixels v and v be- 

7 8 

longing to first and second 8x8 blocks having different QP 
values. Similar to as shown in Fig. 12, the asymmetric F-3 
filter shown in Fig. 13 is first applied to and then ap- 
plied to v g using the formulas (8) shown above. As previ- 
ously noted, when using the asymmetric filters, slightly 
more weighting is given to the adjacent 8x8 block when 
compared with the symmetric filters. Intuitively, this has 
an effect similar to adjusting the QP values of the two ad- 
jacent 8x8 blocks to be equivalent as shown in Fig. 9. 
[0088] Fig. 14 is a flowchart further describing the mode decision 
procedure for Category 1. For Category 1, up to four pix- 
els from v to v around the block boundary 600 are fil- 

6 9 

tered. As previously shown in Fig. 6, in step 610, if at least 
one of either the first block 602 or the second block 604 
is an intra coded block, the block boundary 600 is deter- 
mined to be in Category 1. Fig. 14 further details the 
threshold values required to determine the region mode. 
In step 612, if the activity value ACTIVITY, calculated ac- 



cording to the formula (1) specified above, is greater than 
a THOJNTRA threshold value, the region mode is deter- 
mined to be an active region. The THOJNTRA threshold 
value distinguishes active regions from more flat regions 
for Category 1 and is a variable threshold value that adap- 
tively changes according to the present invention. Further 
description of the determination of the THOJNTRA 
threshold value will be provided later in the detailed de- 
scription of the present invention. If ACTIVITY is less than 
or equal to the THOJNTRA threshold value, the activity 
value ACTIVITY is compared with a fixed threshold having 
a value of 6. The fixed threshold is used to further divide 
the more flat regions into smooth and dormant regions in 
order to control the strength of the low-pass filtering op- 
eration. If ACTIVITY is greater than the fixed threshold, 
the region mode is determined to be a smooth region; 
otherwise, if ACTIVITY is less than or equal to the fixed 
threshold, the region mode is determined to be a dormant 
region. Although the value 6 for the fixed threshold has 
been determined using extensive experimentation, it 
should be noted the present invention is not limited to a 
fixed threshold value of 6. Other fixed threshold values 
can also be used while still following the teachings of the 



present invention. 

[0089] please refer to Fig. 15 and Fig. 16. Fig. 15 shows a flowchart 
describing the operation of the de-blocking filtering unit 
328 for a Category 1 type block boundary 600 when the 
region mode is determined to be Ml-INTRA. Fig. 16 shows 
the results of the filtering operations described in Fig. 15 
on the pixels around the block boundary 600. The 
flowchart shown in Fig. 15 includes the following steps: 

[0090] step 1500:Calculate the high frequency component c 3 of 
the HT as: c = (v -v +v -v )/2. Define another variable 

3 6 7 8 9 

threshold TH1JNTRA and compare TH1JNTRA to C 3 to 
check if the block edge is indeed a real edge that should 
be present in the image. If the high frequency component 
c 3 is larger than or equal to TH1JNTRA, the block edge is 
assumed to be a real edge and filtering is not applied. 
Otherwise, filter and v g using the F-l filter previously 
described. If filtering is performed in step 1500, proceed 
to step 1502. 

[0091] step 1502:Recalculate the high frequency component c 3 
as: c = (v -v +v "-v )/2, where v " is the filtered result 

3 5 6 7 8' 7 

from step 1500. If c is smaller than QP1, then v and v " 

3 6 7 

are filtered using the F-l filter. In step 1502, because v 

6 

and v " are coded with the same quantization parameter 



QP1, both weighting factors in formula (3) are set to 1/2. 
Proceed to step 1504. 
[0092] step 1504:Recalculate the high frequency component c 3 
as: c = (v "-v "+v -v )/2, where v "is the filtered result 

3 7 8 9 10 7 

from step 1502 and v g " is the filtered result from step 
1500. If c 3 is smaller than QP2, then v g " and v g are filtered 
using the F-l filter. In step 1504, because v " and v are 

8 9 

coded with the same quantization parameter QP2, both 
weights in formula (3) are again set to 1/2. 

[0093] please refer to Fig. 17 and Fig. 18. Fig. 17 shows a flowchart 
describing the operation of the de-blocking filtering unit 
328 for a Category 1 type block boundary 600 when the 
region mode is determined to be M2-INTRA. Fig. 18 shows 
the results of the filtering operations described in Fig. 17 
on the pixels around the block boundary 600. The 
flowchart shown in Fig. 17 includes the following steps: 

[0094] step 1700:Calculate a difference value as: diff = |v -v |. 

7 8 

Define another variable threshold TH2JNTRA and com- 
pare TH2JNTRA to the difference value diff to check if the 
block edge is indeed a real edge.TH2_INTRA is a variable 
threshold and is also determined adaptively according to 
the present invention. The purpose of TH2JNTRA is the 
same as that of TH1JNTRA. If diff is smaller than 



TH2JNTRA and ACTIVITY is greater than the fixed thresh- 
old (in this embodiment the fixed threshold has a fixed 
value of 6), then filter and v g using the F-2 filter previ- 
ously described. If QP1 is equal to QP2, use the symmetric 
F-2 filter; otherwise, if QP1 is not equal to QP2, use the 
asymmetric F-2 filter. If filtering is performed in step 
1700, proceed to step 1702. 
[0095] step 1702:Recalculate the difference value as: diff = |v 5 -v 
"|, where v 7 " is the filtered result from stepl700. If diff is 
smaller than QP1 and ACTIVITY is greater than the fixed 
threshold, filter v using the symmetric weak low-pass fil- 

6 

ter F-2, i.e., 

v\ = (v f + 3-^ + 8- v ( + 3 - v 7 '+^ 8 l )/16 

[0096] step 1704:Recalculate the difference value as: diff = |v "- 

8 

v |, where v " is the filtered result from step 1702. If diff 

10 8 

is smaller than QP2 and ACTIVITY is greater than the fixed 
threshold, filter v g using the symmetric weak low-pass fil- 
ter F-2, i.e., 

v' 9 = (y 7 '+ 3 ■ v 8 '+8 -v 9 + 3 ■ v 10 + v u ) / 1 6 

[0097] please refer to Fig. 19 and Fig. 20. Fig. 19 shows a flowchart 
describing the operation of the de-blocking filtering unit 
328 for a Category 1 type block boundary 600 when the 



region mode is determined to be M3-INTRA. Fig. 20 shows 
the results of the filtering operations described in Fig. 19 
on the pixels around the block boundary 600. The 
flowchart shown in Fig. 19 includes the following steps: 
[0098] step 1900:Calculate a difference value as: diff = |v -v |. 

7 8 

Compare TH2JNTRA to diff to check if the block edge is 
indeed a real edge. If diff is smaller than the variable 
threshold TH2JNTRA and ACTIVITY is less than or equal 
to the fixed threshold, then filter v and v using F-3. If 

7 8 3 

QP1 is equal to QP2, use the symmetric F-3 filter; other- 
wise, if QP1 is not equal to QP2, use the asymmetric F-3 
filter. If filtering is performed in step 1900, proceed to 
step 1902. 

[0099] step 1902:Recalculate the difference value as: diff = |v 5 -v 
7 "|, where v 7 " is the filtered result from step 1900. If diff 
is smaller than QP1 and ACTIVITY is less than or equal to 
the fixed threshold, filter v using the symmetric strong 

6 

low-pass filter F-3, i.e., 

V' c = (^ +2-Vj + 2- V ( +2 - v 7 '+v s ')/S 

[0100] step 1904:Recalculate the difference value as: diff = |v "- 

8 

v |, where v " is the filtered result from step 1902. If diff 

10 8 K 

is smaller than QP2 and ACTIVITY is less than or equal to 



the fixed threshold, filter v^using the symmetric strong 
low-pass filter F-3, i.e., 

V 9 = ( V l ' +2 ■ V S 1+2 ■ V 9 + 2 ■ V l* + V ll) /S 

[° 101 ] Fig. 21 is a flowchart further describing the mode decision 
procedure for Category 2.As previously mentioned, be- 
cause of motion compensated prediction, blocking arti- 
facts may exist at any position inside inter coded blocks. 
Thus, for Category 2, up to eight pixels (from to v ) 
around the block boundary 600 are filtered. As previously 
shown in Fig. 6, in step 610, if neither the first block 602 
nor the second block 604 is an intra coded block, the 
block boundary 600 is determined to be in Category 2. 
Fig. 21 further details the threshold values required to de- 
termine the region mode. In step 616, if the activity value 
ACTIVITY, calculated according to formula (1) specified 
above, is greater than a TH0JNTER threshold value, the 
region mode is determined to be an active region. The 
TH0JNTER threshold value distinguishes active regions 
from more flat regions for Category 2 and is a variable 
threshold value that adaptively changes according to the 
present invention. Further description of the determina- 
tion of the TH0JNTER threshold value will be provided 



later in the detailed description of the present invention. If 
ACTIVITY is less than or equal to the THOJNTER threshold 
value, the activity value ACTIVITY is compared with the 
fixed threshold (having a value of 6 in this embodiment). 
As in Category 1, the fixed threshold is used to further di- 
vide the more flat regions into smooth and dormant re- 
gions in order to control the strength of the low-pass fil- 
tering operation. If the ACTIVITY is greater than the fixed 
threshold, the region mode is determined to be a smooth 
region; otherwise, if ACTIVITY is less than or equal to the 
fixed threshold, the region mode is determined to be a 
dormant region. Again, although the value 6 for the fixed 
threshold has been determined to be a suitable value us- 
ing experimental results, it should be noted the present 
invention is not limited to a fixed threshold value of 6. 
Other fixed threshold values can also be used while still 
following the teachings of the present invention. 
[0102] please refer to Fig. 22 and Fig. 23. Fig. 22 shows a flowchart 
describing the operation of the de-blocking filtering unit 
328 for a Category 2 type block boundary 600 when the 
region mode is determined to be MI-INTER. Fig. 23 shows 
the results of the filtering operations described in Fig. 22 
on the pixels around the block boundary 600. The 



flowchart shown in Fig. 22 includes the following steps: 
[0103] step 2200:Calculate the high frequency component c 3 of 
the HTas: c = (v -v +v -v )/2. Define another variable 

3 6 7 8 9" 

threshold TH1JNTER and compare TH1JNTER to C 3 to 
check if the block edge is indeed a real edge. If the high 
frequency component c 3 is larger than or equal to 
TH1JNTER, the block edge is assumed to be a real edge 
and filtering is not applied. Otherwise, filter v and v us- 

7 8 

ing the F-l filter. If filtering is performed in step 2200, 
proceed to step 2202. 
[0104] step 2202:Recalculate the high frequency component c 3 
as: c = (v -v +v -v )/2. If c is smaller than QP1/2, then 

3 3 4 5 6 3 

filter v and v using the F-l filter. In step 2202, because 
4 5 

v 4 and v s are coded with the same quantization parameter 
QP1, both weights in formula (3) are again set to 1/2. 
[0105] step 2204:Recalculate the high frequency component c 3 
as: c = (v "-v +v "-v ")/2, where v " and v "are the fil- 

3 5 6 7 8 7 8 

tered results from step 2200, and v 5 " is the filtered result 
from step 2202. If c is smaller than QP1, filter v and v 

3 6 

"using the F-l filter. In step 2204, because v and v "are 

7 6 7 

coded with the same quantization parameter QP1, both 
weights in formula (3) are again set to 1/2. 
[0106] step 2206:Recalculate the high frequency component c 



as: c = (v -v +v -v )/2. If c is smaller than QP2/2, 

3 9 10 11 12" 3 ^ ' ' 

filter v and v using the F-l filter. In step 2206, because 
10 n a 

v and v are coded with the same quantization parame- 

10 11 

ter QP2, both weights in formula (3) are again set to 1/2. 
[0107] step 2208:Recalculate the high frequency component c 3 
as: c = (v "-v "+v -v ")/2, where v "is the filtered result 

3 7 8 9 10 7 

from step 2204, and v " and v "are the filtered results 

K 8 10 

from steps 2200 and step 2206, respectively. If c 3 is 

smaller than QP2, filter v " and v using the F-l filter. In 

8 9 a 

step 2208, because v and v are coded with the same 

8 9 

quantization parameter QP2, both weights in formula (3) 
are again set to 1/2. 

[0108] please refer to Fig. 24 and Fig. 25. Fig. 24 shows a flowchart 
describing the operation of the de-blocking filtering unit 
328 for a Category 2 type block boundary 600 when the 
region mode is determined to be M2-INTER. Fig. 25 shows 
the results of the filtering operations described in Fig. 24 
on the pixels around the block boundary 600. The 
flowchart shown in Fig. 24 includes the following steps: 

[0109] step 2400:Calculate a difference value as: diff = |v -v |. 

7 8 

Define another variable threshold TH2JNTER and com- 
pare TH2JNTER to diff to check if the block edge is in- 
deed a real edge.TH2_INTER is a variable threshold and is 



also determined adaptively according to the present in- 
vention. The purpose of TH2JNTER is the same as that of 
TH1JNTER. If diff is smaller than TH2JNTER and ACTIV- 
ITY is greater than the fixed threshold, then filter and v 
using the F-2 filter. If QP1 is equal to QP2, use the sym- 

8 

metric F-2 filter; otherwise, if QP1 is not equal to QP2, 
use the asymmetric F-2 filter. If filtering is performed in 
step 2400, proceed to step 2402. 
[OHO] Step 2402: Recalculate the difference value as: diff = |v 3 ~v 
|. If diff is smaller than QP1/2 and ACTIVITY is greater 
than the fixed threshold, filter and using a 3-tap 
low-pass filter [1 6 l]/8, i.e., 

v t '=(v 3 + 6v t + Vj)/8 , v :i l =(y + +6- Vj +v ( )/S 

Step 2404:Recalculate the difference value as: diff = |v 7 "- 
v 5 "|, where v 7 " is the filtered result from step 2400 and v 
" is the filtered result from step 2402. If diff is smaller 
than QP1 and ACTIVITY is greater than the fixed thresh- 
old, filter v using the symmetric weak low-pass filter F-2, 

6 

i.e., 

v ( '= (y + '+3 ■ Vj '+8 ■ v fi + 3 ■ v 7 '+ v s ') /l 6 

[0112] step 2406:Recalculate the difference value as: diff = |v - 

10 

v^l. If diff is smaller than QP2/2 and ACTIVITY is greater 



than the fixed threshold, filter v and v using the 3-tap 

11 10 a K 

low-pass filter [1 6 l]/8, i.e., 

V=(^ +6 ^ll + ^12) /S - V=0 S + 6 ^ +V ll) /S 

[° 113 ] Step 2408:Recalculate the difference value as: diff = |v "- 

8 

v "|, where v " is the filtered result from step 2400 and v 
10 ' 8 K 

" is the filtered result from step 2406. If diff is smaller 
10 K 

than QP2 and ACTIVITY is greater than the fixed thresh- 
old, filter v g using the symmetric weak low-pass filter F-2, 
i.e., 

* 9 -(V+3-v t '+8-v 9 + 3-V+V)/lfi 

[° 114 ] Please refer to Fig. 26 and Fig. 27. Fig. 26 shows a flowchart 
describing the operation of the de-blocking filtering unit 
328 for a Category 2 type block boundary 600 when the 
region mode is determined to be M3-INTER. Fig. 27 shows 
the results of the filtering operations described in Fig. 26 
on the pixels around the block boundary 600. The 
flowchart shown in Fig. 26 includes the following steps: 

[° 115 ] Step 2600:Calculate a difference value as: diff = |v -v |. 

K 7 8 

Compare TH2JNTER to diff to check if the block edge is 
indeed a real edge. If diff is smaller than TH2JNTER and 
ACTIVITY is less than or equal to the fixed threshold, filter 
v and v using the F-3 filter. If QP1 is equal to QP2, use 

7 8 



the symmetric F-3 filter; otherwise, if QP1 is not equal to 
QP2, use the asymmetric F-3 filter. If filtering is per- 
formed in step 2600, proceed to step 2602. 
[0116] step 2602: Recalculate the difference value as: diff = |v 3 ~v 
|. If diff is smaller than QP1/2 and ACTIVITY is less than 
or equal to the fixed threshold, filter and v s using the 
3-tap low-pass filter [1 6 l]/8, i.e., 

[° 1 1 y ] Step 2604:Recalculate the difference value as: diff = |v "- 
v 5 "|, where v 7 " is the filtered result from step 2600 and v 
s " is the filtered result from step 2602. If diff is smaller 
than QP1 and ACTIVITY is less than or equal to the fixed 
threshold, filter v using the symmetric weak low-pass fil- 

6 

ter F-3, i.e., 

v i '= (v + '+2 ■ v 5 1 +2 ■ v t + 2 ■ v 7 '+v s ') / 8 

[0118] Step 2606:Recalculate the difference value as: diff = |v - 

10 

v |. If diff is smaller than QP2/2 and ACTIVITY is less 
than or equal to the fixed threshold, filter v and v us- 

M 11 10 

ing the 3-tap low-pass filter [1 6 l]/8, i.e., 



[° 119 ] Step 2608:Recalculate the difference value as: diff = |v "- 

8 

v "|, where v " is the filtered result from step 2600 and v 

10 8 K 

" is the filtered result from step 2606. If diff is smaller 
10 K 

than QP2 and ACTIVITY is less than or equal to the fixed 
threshold, filter v g using the symmetric weak low-pass fil- 
ter F-3, i.e., 

[0120] it should be noted that the filtering order for Category 2 
filtering operations is not sequential from pixels at the 
block boundary 600 to pixels furthest away from the 
block boundary. Instead, after filtering the pixels at the 
block boundary 600, pixels further away from the block 
boundary 600 are filtered. Afterwards, pixels between the 
pixels at the block boundary 600 and the pixels further 
away from the block boundary 600 are filtered. By doing 
so, the error caused by filtering the pixels at the block 
boundary 600 is not propagated to inner-block pixels 
further away from the block boundary 600. 

[0121] Fig. 28 shows a horizontal boundary in two field pictures 
corresponding to a single frame in interlaced video. By 
slightly modifying the filtering operation for field-coded 
pictures (used to form interlaced video), the present in- 



vention provides a method that enables the de-blocking 
filtering unit 328 to be used for field-coded pictures. For 
interlaced video, one frame is coded with two field-coded 
pictures: an odd-field picture and an even-field picture. 
As such, special consideration needs to be taken when 
performing vertical filtering, i.e., horizontal boundary fil- 
tering. According to the present invention, the same filter 
is applied to vertical filtering of filed-coded picture with 
only a small and easy to implement modification. For the 
active region mode, the same filter F-l is used except 
that high frequency component c 3 is reduced to one half, 
instead of 0, i.e., 

A 

in formula (2) is c 3 /2. Additionally, the filtered pixels are 
clipped into a narrower range as follows: 

v' 7 = v 1 + Al , v' 9 = v s - A2 where 
Al = clip(A Wn, 0, ^ s ~ Vy) WTl) , A2-dip(A-WT2, 0, WT2) 

[0122] For the smooth and dormant region modes, pixel interpo- 
lation is performed before filtering. Since the distance be- 
tween two vertically adjacent pixels in a field-coded pic- 
ture is actually equivalent to 2 pixels in a frame-coded 



picture, the pixel value between these two vertically adja- 
cent pixels can be estimated using an interpolation tech- 
nique. Although a more sophisticated interpolation calcu- 
lation may give slightly better performance, a preferred 
embodiment of the present invention uses simple averag- 
ing in order to reduce the computational complexity of 
the interpolation unit 330. 
[0123] Fig. 29 shows the averaging operations used to implement 
the interpolation operations for horizontal boundary fil- 
tering of a field-coded picture according to the present 
invention. After interpolation, the same filtering opera- 
tions as previously described for frame-coded pictures is 
applied to the field-coded pictures. For example, suppose 
that v 7 and v g are to be filtered with the symmetric low- 
pass filter F-2. In this case, the after filtered results 
and v " are as calculated as follows: 

8 

v\=(y i +3-A + 8- v 7 + 3b + v s )/16, v' 8 = (v 7 + 3-i +8-v 8 + 3-c + v 9 )/16 , 

where a, b, and care the interpolated pixel values as 
shown in FIG. 29. 
[0124] M 0St 0 f t he prior art as well as the present invention use 
several threshold values to control the filtering strength 
and to make filtering decisions. Accordingly, threshold 
values used in the adaptive de-blocking filtering unit 328 



have a great influence on the de-blocking filtering perfor- 
mance. That is, a good threshold selection method is an 
important factor in the performance of an adaptive de- 
blocking filter. However, thresholds in most of the prior 
art de-blocking filters are usually decided without careful 
consideration despite their importance. The present in- 
vention provides a general guideline for threshold selec- 
tion and uses linear functions of several parameters to 
determine the threshold values. 

[0125] The strength of a blocking artifact depends on the follow- 
ing five factors: 

[0126] (i) The QP values of the two adjacent 8x8 blocks that 
form the block boundary. A coarser quantization step 
makes blocking artifacts more visible. 

[0127] (2) The difference of QP values of two adjacent 8x8 

blocks. Blocking artifacts tend to be stronger when adja- 
cent blocks are coded with different quantization parame- 
ters. This is true even if the sum of the QP values of two 
8x8 blocks having different QP values is equal to the sum 
of the QP values of two 8x8 blocks having equal QP val- 
ues. The blocking artifact between the two 8x8 blocks 
having different QP values will tend to be stronger. 

[0128] (3) Block and picture coding types. Inter-coded blocks are 



generally smoother than intra-coded blocks because 
adding predicted signals using motion compensation and 
residual error signals has an effect similar to averaging. 
This tends to reduce noise, which reduces blocking arti- 
facts. For the same reason, B-pictures are even smoother 
than P-pictures, and therefore have reduced blocking arti- 
facts. 

[0129] (4) size of motion vector. When a large motion exists in a 
picture, the picture tends to be smoother and have re- 
duced blocking artifacts. 

[° 13 °] (5) If the 8x8 block boundary is also MB boundary, in P- 
and B-pictures, blocking artifacts tends to be more visi- 
ble. 

[0131] Threshold values should be determined based on the 

strength of the blocking artifact. Therefore, the present 
invention considers the above five factors when deciding 
the threshold values. Moreover, the present invention in- 
troduces a parameter called a user-defined offset (UDO), 
which enables a trade-off between subjective quality and 
objective measurement quality depending on the user's 
preference. For example, using a large UDO increases the 
amount of filtering and therefore the amount of smooth- 
ing. On the contrary, using a small UDO decreases the 



amount of filtering so more image details are preserved. 
The thresholds can be obtained either from pre-generated 
tables or from a mathematical formula. While the present 
invention provides simple mathematical formulas, the 
threshold tables can also be generated and used to per- 
form a look-up operation. The threshold tables can be 
based on the mathematical formulas given below. 
[0132] For block boundaries in Category 1, a general linear func- 
tion that can be used to determine threshold values can 
be formulated as follows: 

Threshold =a + b- (QPl + QP2) + c ■ \QP\ - QP2\ + d ■ UDO (9) 

[0133] Specifically, the thresholds used in Category 1 are deter- 
mined as shown in the following formulas: 

TH 0 _ INTRA = -2 + (QPl + QFI) + 2 ■ UDO 

Tm_INTRA=-l + ^(QPl + QP2) + ^\QPl-QP2\+UDO (10) 
TH2 _INTPA = -2 + (QPl + QPJ) + \QP\ - QP2\+ 2 UDO 

[0134] For block boundaries in Category 2, a general linear func- 
tion that can be used to determine threshold values can 
be formulated as follows: 

Threshold =a+b- (QPl + QPJ) + c ■ \QP\ - QP2\ + d ■ MVI+e ■ BFlag + / ■ UDO (1 1) 

[0135] | n formula (11), the MVI parameter represents the motion 
vector indicator, which is a function of the picture size as 



previously described, and BFlag parameter represents 
whether the picture is B-picture or not. If the picture is B- 
picture, BFlag is set to 1; otherwise, BFlag is set to 0. 
Specifically, the thresholds used in Category 2 are deter- 
mined as shown in the following formulas: 

THQ_MTBR = -2+(QPl + QP2) - 2 ■ MVI - 2 ■ BFlag + 2 ■ UDO 

THl _ INTER- a + 1 ■ (QPl + QP2) +^ \QR- QP2\ + 2 ■ MVI- 2 ■ BF!ag+ UDO (12) 
7H2 _ INTER = a * (QPl * QP2) + I \QPl - QP2\ - 2 MVI - 2 ■ BFlag + 2 ■ UDO 

[0136] | n the formulas (12), when the 8x8 block boundary is also 
a MB boundary, a is set tol; otherwise, a is set to 3. 

[0137] As shown above, there are common drawbacks in the 

adaptive de-blocking methods of the prior art. One prob- 
lem associated with the prior art adaptive de-blocking 
methods is that they do not consider changes in the 
quantization parameter (QP) between adjacent mac- 
roblocks (MBs). The QP values of MBs may vary inside a 
frame when the video is encoded with an encoder opti- 
mization technique, such as MB-based rate control algo- 
rithms. In this case, adjacent 8x8 blocks can be quantized 
with different QP values when these 8x8 blocks belong to 
different MBs. Since blocking artifacts between two blocks 
encoded with different QPs tend to be more visible in 



general, the strength of the de-blocking filter according 
to the present invention is dynamically adapted to account 
for the QP value change. The threshold values used for the 
filtering decisions are also dynamically adapted to the QP 
value change. 

[0138] Another common problem with prior adaptive de-blocking 
methods is that they do not consider blocking artifacts 
caused by motion compensated prediction. For inter- 
coded frames, since the blocking artifacts in the reference 
frames may propagate to the current frames and result in 
an inner-block blocking artifact, more pixels around the 
block boundary between two inter-coded blocks are ex- 
amined and filtered according to the present invention. 
Additionally, in most of the prior art, the threshold values 
used for adjusting the filtering strength are determined 
without consideration of various coding parameters. For 
example, since blocking artifacts in inter-coded frames 
tend to be less visible because of the smoothing effect 
caused by adding the residual error signal and the refer- 
ence signal, thresholds determined according to the 
present invention depend on the block coding type. In the 
prior art, only the in-loop de-blocking method proposed 
by List et al. (reference [9]) decides Bs parameter based on 



the 4x4 block-coding mode and uses different threshold 
values according to Bs parameter, however, it does not 
fully exploit the block-coding information. 
[0139] Those skilled in the art will readily observe that numerous 
modifications and alterations of the device may be made 
while retaining the teachings of the invention. For exam- 
ple, other low pass filters having different numbers of 
taps or different filtering coefficients could also be used 
according to the present invention. Accordingly, the above 
disclosure should be construed as limited only by the 
metes and bounds of the appended claims. 



